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Summary 


• This  report  reviews  the  literature  on  assessment  of  telecardiology,  considering 
applications  in  pediatric  care,  hospital  or  clinic  use  for  adults,  emergency  care,  and 
home  care. 

• Computerized  literature  searches  from  1992  to  September  2003  were  performed 
using  electronic  databases.  Articles  were  selected  which  described,  in  a 
scientifically  valid  manner,  studies  reporting  clinical,  economic  or  administrative 
outcomes  of  telecardiology.  Both  controlled  studies  and  non-controlled  studies 
with  not  less  than  20  subjects  were  included. 

• The  quality  of  the  selected  studies  was  assessed  using  the  approach  that  took 
account  of  both  study  performance  and  study  design  to  give  an  indication  of  the 
reliability  of  their  results  for  decision  makers. 

• Reliability  of  studies  was  rated  as  high  (high  degree  of  confidence  in  the  findings; 
good  (some  uncertainty  regarding  the  findings;  fair  (some  limitations  that  should 
be  considered  in  any  implementation  of  the  findings;  poor  to  fair  (substantial 
limitations,  findings  should  be  used  cautiously);  or  poor  (findings  were  of 
unacceptable  uncertainty. 

• Those  studies  that  included  cost  or  economic  data  were  also  judged  against 
accepted  criteria  for  economic  analysis. 

• From  527  publications  identified  in  the  literature  search,  46  papers  describing  44 
studies  met  the  selection  criteria  and  were  included  in  the  review. 

• The  majority  of  the  studies  (39  of  44)  concluded  that  telecardiology  had 
advantages  over  the  alternative.  Flowever,  the  quality  of  23  of  these  (59%)  was 
poor  or  poor  to  fair. 

• All  but  one  of  the  studies  on  pediatric  applications  related  to  teletransmission  of 
echocardiography  data.  Reported  benefits  included  savings  in  time  and  cost 
through  avoiding  unnecessary  referrals.  Three  studies  were  of  fair  quality,  with 
the  remainder  providing  weaker  evidence.  Economic  analyses  in  six  studies  were 
of  low  or  very  low  quality.  The  other  pediatric  study,  on  monitoring  of  pacemaker 
performance,  provided  weak  evidence  of  benefit. 

• Six  of  ten  studies  on  applications  in  adult  care  considered  support  for  primary  care 
physicians  through  transmission  of  ECG  results  and  feedback  from  cardiologists. 
There  were  benefits  through  avoidance  of  unnecessary  referrals  and  identification 
of  patients  who  required  urgent  intervention.  One  study  was  judged  to  be  fair, 
with  the  others  having  lower  reliability.  Two  other  studies  indicated  benefits  from 
use  of  telecardiology  in  a prison  service  and  in  support  of  a cardiac  catheterization 
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laboratory.  Feasibility  was  demonstrated,  but  benefits  were  less  clear,  in  studies 
on  use  of  telemetry  outside  critical  care  units  and  on  transmission  of  nuclear 
medicine  results. 

• With  emergency  care  applications  three  studies  considered  transmission  of  ECG 
data  from  ambulance  to  hospital  and  indicated  benefits  through  faster  diagnosis 
and  more  rapid  treatment  of  patients.  One  of  these  studies  was  of  good  quality 
with  the  others  giving  weaker  evidence.  A good  quality  study  on  use  of 
dobutamine  stress  echocardiography  demonstrated  benefits  through  avoidance  of 
unnecessary  hospitalization.  A fair  quality  study  indicated  benefits  from  use  of  a 
fax-based  system  to  provide  out  of  hours  support  to  hospital  house  officers. 

• Nine  of  13  home  care  application  studies  assessed  telemonitoring  of  patients  with 
heart  failure.  Benefits  were  demonstrated  through  reduction  in  hospital 
admissions,  decreased  hospital  stay,  and  lower  hospital  costs.  Four  studies  were 
RCTs  of  high  quality,  two  were  judged  to  be  fair  and  three  were  poor  to  fair.  One 
of  the  high  quality  studies  also  rated  as  fair  to  good  for  its  economic  analysis.  Two 
high  quality  studies  showed  that  home-based  rehabilitation  was  as  effective  as 
programs  undertaken  within  institutions.  One  good  quality  and  one  poor  quality 
study  indicated  useful  gains  in  performance  in  the  monitoring  of  arrhythmias. 

• The  review  shows  that  few  studies  of  telecardiology  in  the  recent  literature  have 
reported  clinical  or  economic  outcomes. 

• On  the  basis  of  information  given  in  the  papers  that  were  reviewed,  the  quality  of 
over  half  the  44  studies  were  judged  to  be  of  poor  or  poor  to  fair.  For 
decision-making  purposes,  they  should  be  regarded  as  providing  no  more  than 
preliminary  indications  of  benefits  and  costs,  requiring  follow  up  to  verify  their 
findings. 

• While  telecardiology  has  had  a long  history,  most  of  the  studies  reported  in  the 
literature  do  not  provide  convincing  evidence  of  benefit. 

• Decision  makers  should  note  the  need  for  follow-up  of  preliminary  studies  in 
order  to  obtain  reliable  outcomes  data  for  telecardiology  applications. 
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Introduction 


Telemedicine  has  been  defined  by  the  US  National  Library  of  Medicine  as  " Delivery  of 
health  services  via  remote  telecommunications.  This  includes  interactive  consultative  and 
diagnostic  services."  In  previous  publications,  we  have  reviewed  available  literature  on 
the  assessment  of  telemedicine  1_3.  In  those  reviews  we  considered  studies  that  had 
included  comparison  of  a telemedicine  application  with  a non-telemedicine  alternative 
and  which  had  reported  administrative  changes,  patient  outcomes  or  results  of 
economic  assessment.  The  intention  was  to  provide  overviews  of  the  available 
reasonable  quality  evidence  on  the  efficacy,  effectiveness  and  economic  impact  of 
telemedicine  applications,  as  guidance  for  decision  makers  in  health  care  and  those  with 
interest  in  this  technology.  These  reviews  indicated  that  although  useful  clinical  and 
economic  outcomes  data  have  been  obtained  for  some  telemedicine  applications,  good 
quality  studies  are  still  scarce  and  generalisability  of  most  assessment  findings  may  be 
limited. 

The  present  report  reviews  the  literature  on  assessment  of  a particular  area  of 
telemedicine-telecardiology.  A review  of  telemedicine  evaluation  by  McDonald  et  al.  4 
has  noted  that  telecardiology  is  one  of  the  oldest  and  most  common  applications  of 
teletransmission.  Telephone  transmission  of  the  electrocardiogram  (ECG)  was 
undertaken  by  Einthoven  as  long  ago  as  1911  and  ausculation  by  telephone  dates  back 
to  1924.  Later  developments  have  included  telephone  (POTS)  transmission  ECGs  for 
ambulatory  arrhythmia  detection  and  diagnosis  of  myocardial  ischaemia,  rural 
teleconsultation  and  tele-echocardiography. 

Despite  this  long  history,  assessment  of  telecardiology  is  required  in  order  to  address 
newer  versions  of  technologies  and. changes  to  organisation  of  health  services.  As  with 
other  areas  of  telemedicine,  there  is  a need  to  consider  safety,  effectiveness,  economic 
impact  and  access  issues  so  as  to  inform  decisions  on  planning  and  implementation  on 
future  health  care  services,  and  on  standards  of  care. 

The  approach  taken  follows  that  in  our  earlier  reviews,  except  that  some  consideration 
is  given  to  non-  comparative  studies  as  well  as  to  controlled  trials.  Four  areas  of 
telecardiology  application  are  covered: 

• Hospital/  clinic  use  - pediatric; 

• Hospital/  clinic  use  - adult; 

• Emergency  care;  and 

• Home  care. 

Clinical,  economic  and  administrative  outcomes  reported  in  the  available  literature  are 
considered  and  also  the  potential  influence  of  the  reviewed  studies  on  policy  decisions. 

j ► *] 

Alberta  Heritage  Foundation  for  Medical  Research  1 

Health  Technology  Assessment 


Methods 


Literature  Search 

Computerized  literature  searches  were  performed  using  electronic  database  entries 
from  1992  to  September  2003.  There  were  no  language  restrictions.  The  data  bases  and 
the  search  strategy  used  are  given  in  Appendix  A. 

Selection  of  publications 

Initial  screening  of  the  identified  articles  was  based  on  their  abstracts.  All  abstracts 
were  read  independently  by  all  the  authors.  Selection  of  relevant  articles  was  based  on 
the  information  obtained  from  the  abstracts  and  was  agreed  upon  in  discussion 
between  the  authors.  When  an  abstract  did  not  give  sufficiently  precise  information 
about  the  study  or  such  information  was  not  available  at  all,  the  article  was  obtained  for 
further  review. 

Articles  were  selected  which  described,  in  a scientifically  valid  manner,  studies 
reporting  clinical,  economic  or  administrative  outcomes  of  telecardiology  in  the 
specified  areas  of  application.  We  included  controlled  studies  in  which  there  was 
comparison  of  telecardiology  with  a non-telemedicine  alternative  and  also 
non-controlled  studies  that  reported  appropriate  outcomes  and  where  the  numbers  of 
subjects  were  not  less  than  20.  We  excluded  studies  that  considered  only  technical 
issues;  those  that  did  no  more  than  establish  technical  feasibility  of  telecardiology, 
including  accuracy  studies;  non-controlled  studies  with  fewer  than  20  subjects;  and 
studies  where  the  information  provided  was  insufficient  to  establish  scientific 
credibility.  Articles  that  were  duplicates  of  other  published  studies  were  also  excluded. 

Full-text  articles  obtained  for  closer  inspection  were  evaluated  independently  by  the 
authors,  who  then  reached  a consensus  on  whether  or  not  an  article  should  be  included 
in  the  final  review,  using  the  criteria  given  above. 

In  describing  each  study  consideration  was  given  to  the  objectives,  approach  taken, 
setting  and  subjects,  type  of  economic  analysis,  results  and  conclusions  of  the 
investigators.  Note  was  taken  of  any  significant  limitations. 

Assessment  of  quality  and  reliability 

Quality  of  the  selected  studies  was  assessed  using  the  approach  described  in  a previous 
review  3,  considering  both  study  performance  and  study  design.  For  study  performance, 
five  areas  of  interest  were  considered,  as  shown  in  Table  1.  When  reviewing  a 
telecardiology  study,  each  of  these  five  areas  was  given  a score  of  0, 1 or  2,  based  on  the 
following  observations: 
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0 = Relevant  information  was  missing  or  given  in  only  minimal  detail 

1 = Reasonable  detail  was  provided  but  there  were  some  important  limitations 

2 = Information  was  satisfactory,  there  were  no  significant  limitations 
Each  study  therefore  had  a possible  maximum  score  of  10  for  performance. 


Table  1:  Classification  of  study  performance 

Areas  of  interest  Points  considered 


1 Patient  selection  Methods  of  randomization/  selection.  Equivalence  of  intervention  and 

control  groups.  Drop  outs  prior  to  commencement  of  intervention 

2 Description/  specification  Adequate  description  for  both  intervention  and  control  groups 
of  the  interventions 


3 

4 

5 


Specification  and  analysis  Sample  size;  statistical  methods  used;  clear  specification  of  outcome 
of  study  measures 


Patient  disposal  Length  of  follow-up;  drop  outs;  compliance  failures 

Outcomes  reported  Fullness  and  clarity  of  reporting.  Missing  results;  statistical  summary. 

Whether  conclusions  were  consistent  with  data. 


An  additional  score  was  allocated  to  each  study,  according  to  the  study  design  that  had 
been  used.  Details  are  shown  in  Table  2.  Large  randomized  controlled  trials  (RCTs), 
defined  for  the  purposes  of  this  review  as  those  with  at  least  50  subjects  in  each  arm, 
were  given  a score  of  five.  Smaller  RCTs  had  a score  of  three,  prospective 
non-randomized  studies  two,  retrospective  comparative  studies  one  and  non-controlled 


series  a value  of  zero. 

Table  2:  Classification  of  study  design 

Study  design  Score 

Large  RCT  5 

Small  RCT  3 

Prospective,  non  - randomized  comparative  2 

Retrospective  comparative  1 

Non  - controlled  series  0 


Each  author  independently  assigned  scores  to  each  study.  If  the  authors  disagreed  on 
the  study  design  classification  or  if  individual  scores  for  any  performance  item  differed 
from  each  other  by  more  than  one,  the  discrepancies  were  discussed  and  resolved  by 
consensus.  For  each  study,  the  mean  of  the  authors'  individual  scores  was  reported  to 
the  nearest  0.5. 


A 

la 
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The  performance  and  design  scores  were  then  combined  to  give  an  overall  score  for 
each  study  to  give  an  indication  of  the  confidence  that  decision  makers  should  place  in 
study  findings.  The  maximum  value  was  15  (corresponding  to  a large  RCT  with  no 
significant  limitations).  On  the  basis  of  the  combined  scores,  we  assigned  each  study  to 
one  of  five  categories  to  give  an  indication  of  the  reliability  of  the  findings  that  they 
reported.  Details  are  shown  in  Table  3.  The  definitions  of  the  reliability  categories  were 
based  on  a consensus  judgment. 


Table  3:  Quality  scores  and  implications  for  decision  makers 

Overall  quality  Reliability  Implications  for  decision  makers 

score 


11.5  -15 

A 

High  quality;  high  degree  of  confidence  in  study  findings 

9.5-11.0 

B 

Good  quality;  some  uncertainty  regarding  the  study  findings 

7.5 -9.0 

C 

Fair  quality;  some  limitations  that  should  be  considered  in  any 
implementation  of  study  findings 

5.5 -7.0 

D 

Poor  to  fair  quality;  substantial  limitations  in  the  study,  findings 
should  be  used  cautiously 

<5.0 

E 

Poor  quality;  study  findings  have  unacceptable  uncertainty 

Those  studies  that  included  cost  or  economic  data  were  also  assessed  separately  to 
provide  an  indication  of  the  quality  of  the  economic  analysis  that  had  been  undertaken. 
Studies  were  judged  against  the  criteria  for  economic  analysis  given  by  Drummond  et 
al.5: 

Was  a well-defined  question  posed  in  answerable  form? 

Was  a comprehensive  description  of  the  competing  alternatives  given? 

Was  the  effectiveness  of  the  programmes  or  services  established? 

Were  all  the  important  and  relevant  costs  and  consequences  for  each  alternative 
identified? 

Were  costs  and  consequences  measured  accurately  in  appropriate  physical  units? 

Were  costs  and  consequences  valued  credibly? 

Were  costs  and  consequences  adjusted  for  different  timing? 

Was  an  incremental  analysis  of  costs  and  consequences  of  alternatives 
performed? 

Was  allowance  made  for  uncertainty  in  the  estimates  of  costs  and  consequences? 

Did  the  presentation  and  discussion  of  the  study  results  include  all  issues  of 
concern  to  users? 
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Two  of  the  authors  reviewed  the  publications  that  included  economic  information.  For 
those  where  sufficient  information  was  presented  to  justify  classification  as  an  economic 
study,  a score  of  1 was  given  for  each  criterion  that  was  fulfilled  in  a satisfactory  way, 
with  no  significant  limitations.  A summary  score  from  0 to  10  was  given  to  each  study, 
with  any  difference  in  scores  from  the  reviewers  being  resolved  by  consensus.  If  the 
study  fulfilled  at  least  five  criteria,  it  was  considered  to  provide  at  least  moderately 
good  information  on  the  economic  indications  of  the  telecardiology  application.  These 
scores  were  separate  to  the  design/  performance  scores  described  previously. 


Alberta  Heritage  Foundation  for  Medical  Research 
Health  Technology  Assessment 


5 


Results 


Retrieved  Articles 

From  the  527  publications  identified  in  the  literature  search,  79  were  retrieved  for  closer 
inspection.  From  these,  45  papers  describing  43  studies  were  judged  to  meet  the 
selection  criteria  and  were  included  in  the  review.  A further  publication  was  identified 
though  from  a separate  project  to  give  a total  of  44  studies  for  consideration  6~51.  Three 
of  the  46  selected  publications  were  non-English  language  and  there  were  four 
non-English  language  papers  among  the  34  publications  that  were  excluded. 

Identification  and  selection  of  the  studies  are  summarized  in  Figure  1. 

Study  classification 

Table  4 shows  numbers  of  studies  reviewed  by  area  of  application  and  study  design. 
Further  details  of  each  study  are  given  in  Appendix  B.  Thirty  five  of  the  studies 
considered  clinical  outcomes,  and  18  administrative  outcomes.  Some  form  of  economic 
analysis  was  included  in  19  of  the  studies  and  all  but  one  of  these  also  included  clinical 
and/or  administrative  details. 


Table  4:  Summary  of  selected  studies 


Study  design 

Type  of  application 

Neonatal, 

pediatric 

Adult,  hospital  and 
clinic 

Emergency 

care 

Home  care 

Large  RCT 

3 

Small  RCT 

3 

Prospective 

comparative 

2 

3 

4 

Retrospective 

comparative 

5 

1 

2 

2 

Case  series 

11 

7 

1 

Total 

16 

10 

5 

13 
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Figure  1:  Identification  and  selection  of  studies 


Alberta  Heritage  Foundation  for  Medical  Research 
Health  Technology  Assessment 


7 


Evidence  for  the  benefits  of  telecardiology  applications:  a systematic  review 


The  settings  for  the  studies  and  the  countries  in  which  they  were  conducted  are  shown 
in  Tables  5 and  6. 

Table  5:  Settings  for  telecardiology  studies 


Type  of  setting 

Type  of  application 

Neonatal, 

pediatric 

Adult,  hospital  Emergency 

and  clinic  care 

Home  care 

: : 

Major  hospital  and  smaller 
hospital 

11 

2 

Hospital  and  outreach  clinic  or 
general  practice 

4 

7 

Hospital  and  home  follow  up 

1 

1 

12 

General  practice  and  home  follow 
up 

1 

Hospital  - consultant 

1 

Within  hospital 

1 

Ambulance  - hospital 

3 

Table  6:  Origin  of  studies 

Country  Number  of  studies 

USA  28 

UK  4 

Italy  3 

Greece  2 

Greece  and  Italy  1 

Australia  1 

Brazil  1 

Canada  1 

Denmark  1 

India  1 

Norway  1 
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Study  quality 

Tables  7 to  9 give  summary  details  of  the  quality  scores  for  the  selected  studies.  Quality 
scores  for  individual  studies  are  given  in  Appendix  B. 

Table  7 shows  the  numbers  of  studies  in  each  application  by  the  performance  scores 
that  they  were  given,  out  of  a maximum  of  10.  Those  in  category  (i)  were  of  good 
quality,  with  adequate  and  appropriate  detail  provided  for  each  study.  The  remainder 
were  of  poorer  quality.  The  21  studies  in  categories  (iii)  and  (iv)  would  give  some 
concern  as  to  the  validity  of  their  results,  as  there  were  some  important  limitations  in  all 
five  of  the  areas  of  interest  given  in  the  Methods  section  and  in  most  cases  relevant 
information  was  missing  or  given  in  only  minimal  detail. 


Table  7:  Performance  scores  for  selected  studies 


Summary  performance  score 

Number  of  studies 

Neonatal, 

pediatric 

Adult,  hospital 
and  clinic 

Emergency 

care 

Home  care 

(i ) (Good) 

8.0-10.0 

2 

0 

2 

6 

(ii)  (Fair) 

6.0  -7.5 

5 

4 

1 

3 

(iii)  (Fair  to  Poor) 

4.0 -5.5 

3 

4 

1 

3 

(iv)  (Poor) 

<3.5 

6 

2 

1 

1 

Overall  quality  scores  for  the  studies  are  given  in  Table  8 (the  maximum  score  was  15). 
Only  six  studies  of  home  care  applications  (14  % of  the  total)  achieved  the  highest  score 
range,  corresponding  to  Category  A for  reliability.  For  these,  there  was  confidence  that 
there  were  adequate  descriptions  of  the  studies  and  that  they  had  been  carried  out 
competently.  At  the  other  end  of  the  scale,  there  were  15  studies  (34%)  in  Category  D 
with'substantial  limitations  and  of  possibly  limited  validity  and  12  (28  %)  in  Category  E 
that  might  be  regarded  as  unacceptable  for  decision  makers. 


in 
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Table  8:  Overall  scores  and  reliability  for  selected  studies 


Overall 

quality 

score 

Reliability 

Implications  for  decision 
making 

Number  of  studies 

Neonatal, 

pediatric 

i 

Adult, 
hospital 
and  clinic 

Emergency 

care 

Home 

care 

. 

11.5-15 

A 

High  quality;  high  degree 
of  confidence  in  study 
findings 

0 

0 

0 

6 

9.5- 

11.0 

B 

Good  quality;  some 
uncertainty  regarding  the 
study  findings 

0 

0 

2 

1 

7.5 -9.0 

C 

Fair  quality;  some 
limitations  that  should  be 
considered  in  any 
implementation  of  study 
findings 

3 

2 

1 

2 

5.5 -7.0 

D 

Poor  to  fair  quality; 
substantial  limitations  in 
the  study,  findings  should 
be  used  cautiously 

6 

5 

1 

3 

<5.0 

E 

Poor  quality;  unacceptable 
uncertainty  for  study 
findings 

7 

3 

1 

1 

Table  9 shows  the  mean  performance  score  by  type  of  study  design.  Studies  with 
stronger  designs  (RCTs  and  prospective  non-randomized  controlled  trials)  tended  to 
have  higher  performance  scores  than  retrospective  studies  or  case  series,  indicating  a 
more  rigorous  approach  to  conduct  of  the  investigations  and/or  more  detailed 
reporting  of  trial  methods  and  results. 


Table  9:  Performance  score  by  type  of  study  design 


Study  design 

No  of  studies 

Performance  score  data 

Mean  Range  (SD) 

RCTs 

6 

7.9  5.5 -9.0  (1.2) 

Prospective 

9 

6.9  4.5 -9.5  (1.6) 

Retrospective 

12 

4.6  2.5 -7.5  (1.9) 

Case  series 

17 

5.0  1.5 -8.5  (2.2) 
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Quality  of  economic  studies 

Of  the  papers  that  included  cost  or  other  economic  information,  ten  6-7-8-14-19— -4-''1-4-48 
could  not  be  considered  as  economic  studies  as  they  included  too  few  details  or  did  not 
provide  an  analysis  of  the  data  relating  to  telecardiology. 

Twelve  reports  included  economic  studies.  One  of  these  utilized  cost-effectiveness 
analysis  and  all  the  others  used  cost  analysis.  The  quality  scores  for  the  economic 
analysis  in  the  reviewed  papers  varied  between  1 and  5 points  (Table  10).  Only  one  of 
the  studies  that  included  economic  analysis  met  five  or  more  of  the  ten  criteria  for 
economic  analyses  given  by  Drummond  et  al.5.  The  individual  economic  quality  scores 
are  shown  together  with  the  other  quality  scores  in  Appendix  B. 

One  good  to  fair  quality  economic  study  was  found  in  home  monitoring  of  heart  failure 
patients  and  two  other  studies  in  that  category  got  low  quality  scores.  Home 
monitoring,  prison  care,  general  practitioner  to  specialist,  and  telephone  homecare  had 
each  one  study  that  got  a low  score.  The  scores  of  neonatal/ pediatric  care  were  mainly 
very  low.  The  average  quality  rating  was  2.69,  indicating  that  the  economic  studies  do 
not  provide  enough  high  quality  information  for  decision  making  on  telecardiology 
applications. 

Table  10:  Classification  of  quality  of  economic  studies  scores 


Score 

Number 

Quality 

10-8 

0 

Good 

7-5 

1 

Good  to  fair 

4-3 

7 

Low 

2-1 

4 

Very  low 

Conclusions  reached  in  studies 

General  conclusions  reached  in  the  reviewed  papers  are  shown  in  Tables  11-14,  which 
also  include  the  quality  scores  for  each  study.  Further  details  on  the  study  conclusions 
are  given  in  Appendix  B.  The  majority  of  the  studies  (39  of  44)  concluded  that 
telecardiology  had  advantages  over  the  alternative.  However,  the  quality  of  23  of  these 
(59%)  was  poor  or  poor  to  fair. 

Impact  and  quality  score  details  for  studies  on  pediatric  applications  are  shown  in  Table 
11.  All  but  one  of  the  studies  were  related  to  teletransmission  of  echocardiography 
data.  Reported  benefits  from  several  studies  included  savings  in  time  and  cost  through 
avoiding  unnecessary  referrals.  Only  three  of  these  15  studies  were  of  fair  quality,  with 
the  remainder  providing  weaker  evidence.  The  quality  of  economic  analyses  in  the  six 
studies  where  they  were  included  was  low  or  very  low. 


is 
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The  other  pediatric  study,  on  monitoring  of  pacemaker  performance,  was  considered  to 
provide  weak  evidence  of  benefit. 


Table  11:  Impact  of  pediatric  applications 


Indications  of  telemedicine  impact 

Performance 
score  (Economic 
study  score) 

Study  design 
score 

Reliability 

Neonatal  echocardiography 

Increase  in  referral  rate  by  pediatricians, 
educational  benefits  6 

4 

(Ec  = 2) 

1 

E 

Avoidance  of  unnecessary  patient  transfer, 
possible  cost  advantages  7 

2.5 

(Ec  = 3) 

1 

E 

Indication.of  lower  costs,  decreased  time  to 
diagnosis  9 

2.5 

(Ec  =1) 

1 

E 

Increased  cost  compared  with  courier  service, 
but  shorter  stay  in  NICU  10 

m 

o 

ii 

hO 

1 

D 

No  evidence  of  effect  on  respiratory  therapy  11 

7 

1 

D 

1 2 

Identified  those  requiring  transfer  to  hospital. 

2.5 

0 

E 

Fewer  studies  ordered  following  telecardiology  13 

6.5 

0 

D 

Facilitated  early  diagnosis  , appropriate 
management,  avoided  transfers  1 

7 

0 

D 

Telemedicine  associated  with  more  tests,  higher 
expenditure  15 

2.5 

1 

E 

Potential  to  improve  patient  management  and 
avoid  unnecessary  transfer 16 

8.5 

0 

C 

Improved  patient  care,  avoided  unnecessary 
transport 17 

5 

(Ec  = 2) 

0 

E 

Reduction  in  transfers  with  cost  savings  18 

6.5 

(Ec  = 1) 

1 

C 

Avoided  unnecessary  transport 19 

1.5 

0 

E 

Excluded  need  for  further  exams,  facilitated 
transfer 20 

8.5 

0 

C 

Excluded  need  for  further  exams,  facilitated 
transfer 21 

4.5 

0 

E 

Monitoring  of  pacemaker  performance 

Indication  of  reliability  of  monitoring  compared  to 
reliance  on  self-  report 8 

3 

0 

E 

[Performance  scores  and  Economic  scores  have  a range  of  0 (worst)  to  10  (best).  Study  design  scores  denote  case 
series  (0),  retrospective  studies  (1),  prospective  studies  (2)  and  RCTs  (3  or  5).  Reliability  values  range  from  E (worst) 
to  A (best).] 


Details  of  studies  on  applications  in  adult  care  are  shown  in  Table  12.  Six  studies  were 
concerned  with  support  for  primary  care  physicians  through  transmission  of  ECG 
results  and  feedback  from  cardiologists.  There  were  benefits  through  avoidance  of 
unnecessary  referrals  and  identification  of  patients  who  required  urgent  intervention. 
One  study  was  judged  to  be  of  fair  quality,  with  the  others  having  lower  reliability. 
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Two  of  the  other  studies  indicated  benefits  from  use  of  telecardiology  in  a prison  service 
and  in  support  of  a cardiac  catheterization  laboratory.  Feasibility  was  demonstrated 
but  benefits  were  less  clear  in  studies  on  use  of  telemetry  outside  critical  care  units  and 
on  transmission  of  nuclear  medicine  results. 


Table  12:  Impact  of  applications  in  adult  care 


Area  of  application 

Indications  of  telemedicine 
impact 

Performance 

score 

(Economic 
study  score) 

Study 

design 

score 

Reliability 

a -a:-  v 

Support  for  GPs,  ECG 
transmission  22 

Urgent  problems  identified, 
managed  by  cardiologist. 

4 

0 

E 

Trans  - telephonic 
ECG  monitoring  23 

Avoided  unnecessary 
admissions,  gave  prompt 
indication  for  urgent  admission. 

5.5 

0 

D 

Support  for  secondary 
care,  ECG  transmission 

25 

Identified  persons  at  risk  of 
adverse  cardiac  events. 

2.5 

0 

E 

Support  for  GPs,  ECG 
transmission  29, 30 

Avoidance  of  inappropriate 
referrals  to  ED  and 
unnecessary  investigations, 
with  consequent  cost  savings. 

5 

(Ec  = 3) 

2 

D 

Support  for  GPs,  ECG 
transmission  31 

Avoided  unnecessary 
hospitalization,  identified 
undiagnosed  cardiac  events. 

6.5 

2 

C 

ECG  transmission, 
thrombolytic  therapy 27 

Identified  patients  with  AMI  who 
were  eligible  for  thrombolysis. 

5 

0 

E 

Telemetry  for  decision 
making  outside  critical 
care  units  24 

Value  of  telemetry  may  be  less 
than  perceived  by  many 
physicians. 

6.5 

0 

D 

Video  link  between 
cardiac  catheterisation 
laboratories  26 

Impact  on  cases  through 
alteration  in  technique  or  in 
clinical  decisions. 

6 

0 

D 

Telecardiology  in  prison 
setting  28 

Cost  benefits  arising  from 
increased  utilization  of  the 
telemedicine  service. 

7.5 

(Ec  = 4) 

1 

C 

Transmission  of 
SPECT  images  from 
perfusion  studies  32 

Alteration  in  treatment  plan  for 
persons  with  suspected  acute 
coronary  symptoms. 

2.5 

0 

E 

[Performance  scores  and  Economic  scores  have  a range  of  0 (worst)  to  10  (best).  Study  design  scores  denote  case 
series  (0),  retrospective  studies  (1),  prospective  studies  (2)  and  RCTs  (3  or  5).  Reliability  values  range  from  E (worst) 
to  A (best).] 


Table  13  includes  information  on  studies  of  emergency  care  applications.  Three  studies 
were  concerned  with  transmission  of  ECG  data  from  ambulance  to  hospital.  All 
indicated  benefits  through  faster  diagnosis  and  more  rapid  treatment  of  patients  after 
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arrival  at  the  hospital.  One  of  these  studies  was  of  good  quality  with  the  others  giving 
weaker  evidence. 

A good  quality  study  on  use  of  dobutamine  stress  echocardiography  demonstrated 
benefits  through  avoidance  of  unnecessary  hospitalization.  A fair  quality  study 
indicated  benefits  from  use  of  a simple  fax-based  system  to  provide  out  of  hours 
support  to  hospital  house  officers. 


T able  13:  Impact  of  emergency  care  applications 


Area  of  application 

Indications  of  telemedicine 
impact 

Performance 

score 

Study  design 
score 

Reliability 

Out  of  hours  faxing 
ECGs  to  assist 
management 
decisions  33 

Avoided  unnecessary 
thrombolysis,  other  inappropriate 
treatment 

6.5 

2 

C 

Dobutamine  stress 
echo  in  evaluation  of 
ER  chest  pain 
patients  34 

Patients  due  for  admission 
because  of  risk  factors,  chest 
pain,  discharged  after  normal 
results. 

8.5 

2 

B 

ECG  transmission 
from  ambulance  to 
hospital,  suspected 
AMI  35 

Faster  ECG  diagnosis 

3.5  ' 

1 

E 

ECG  transmission 
from  ambulance  to 
hospital,  suspected 
AMI  36 

Shorter  time  to  thrombolysis 

5.5 

1 

D 

ECG  transmission 
from  ambulance  to 
hospital,  suspected 
AMI  37 

Reduced  door  to  diagnosis  time 
and  door  to  needle  time 

i 

8 

2 

B 

[Performance  scores  and  Economic  scores  have  a range  of  0 (worst)  to  10  (best).  Study  design  scores 
denote  case  series  (0),  retrospective  studies  (1),  prospective  studies  (2)  and  RCTs  (3  or  5).  Reliability 
values  range  from  E (worst)  to  A (best).] 


Details  of  home  care  application  studies  are  shown  in  Table  14.  The  most  common 
application  covered  was  telemonitoring  of  patients  with  heart  failure.  Benefits  were 
demonstrated  through  reduction  in  hospital  admissions,  decreased  hospital  stay  and 
lower  hospital  costs,  though  sustained  benefit  was  not  demonstrated  in  one  study.  Of 
the  nine  studies  in  this  group,  four  were  RCTs  of  high  quality,  two  were  judged  to  be 
fair  and  three  were  poor  to  fair.  One  of  the  high  quality  studies  also  rated  as  fair  to 
good  for  its  economic  analysis. 

Two  high  quality  studies  showed  that  home-based  rehabilitation  was  as  effective  as 
programs  undertaken  within  institutions.  One  good  quality  and  one  poor  quality  study 
indicated  useful  gains  in  performance  in  the  monitoring  of  arrhythmias. 
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Table  14:  Impact  of  home  care  applications 


Area  of  application 

Indications  of 
telemedicine 
impact 

Performance 
score 
(Economic 
study  score) 

Study 

design 

score 

Reliability 

Telemonitoring  of  patients  with 
congestive  heart  failure  41 

Reduction  in  ER  and 
other  admissions 

6.5 

2 

C 

Program  of  education, 
monitoring  and  physician 
notification  for  patients  with 
heart  failure  42 

Hospital  admissions 
and  LOS  decreased 

5.5 

1 

D 

Remote  video  technology  for 
patients  with  congestive  heart 
failure  and  other  conditions 43 

Cost  savings  and 
improved  access  to 
home  care  support. 

9 

5 

A 

Outpatient  support  for 
congestive  heart  failure 

44 

cases 

Small  improvement  in 
patient  QOL, 
satisfaction  with  the 
program. 

6.5 

0 

D 

Electronic  home  monitoring  in 
chronic  heart  failure  46 

Reduced  ER  and 
hospitalization  rates 

4.5 

2 

D 

Home  telecare,  nurse 
telephone  calls  for  congestive 
heart  failure  patients  47  48 

Readmission 
charges,  ER  visits, 

SS  lower  in  telecare 
and  telephone  groups 

8.5 

3 

A 

Home  telemonitoring  of  heart 
failure  patients 49 

Video  consulting  did 
not  show  sustained 
benefit. 

5.5 

3 

C 

Telephonic  case-management, 
chronic  heart  failure  patients 50 

Lower  hospitalization 
rate,  LOS,  costs 

8 

(Ec  = 3) 

5 

A 

Telemanagement  for  home 
care,  heart  failure  patients 51 

Fewer  readmissions, 
shorter  LOS,  lower 
costs. 

8 

5 

A 

Home  exercise  program  using 
transtelephonic  monitoring  38 

NSD  in  cardiac 
function  between 
home  and  hospital 
groups. 

8.5 

11.5 

A 

Home-based, 

transtelephonically  monitored 
cardiac  rehabilitation  45 

Was  as  effective  as 
on-site  rehabilitation. 

9.5 

2 

A 

Transtelephonic  arrhythmia 

QQ 

monitoring 

More  effective  than 
ambulatory  ECG  for 
the  detection  of 
arrhythmias. 

2.5 

1 

E 

Loop  memory  recorder  in 
diagnosis  of  cardiac 
arrhythmias  40 

Achieved  a useful 
gain  in  diagnostic 
yield. 

7.5 

2 

B 

[Performance  scores  and  Economic  scores  have  a range  of  0 (worst)  to  10  (best).  Study  design  scores  denote 
case  series  (0),  retrospective  studies  (1),  prospective  studies  (2)  and  RCTs  (3  or  5).  Reliability  values  range 
from  E (worst)  to  A (best).] 
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Discussion 


This  review  covers  the  recent  literature  on  telecardiology  to  provide  an  overview  of  the 
available  evidence  supporting  its  use  in  major  applications.  As  in  previous  reviews  of 
telemedicine  assessments,  we  sought  studies  in  which  clinical,  administrative  or 
economic  outcomes  were  reported  1*3.  Given  the  limited  numbers  of  controlled 
telemedicine  assessment  studies  of  all  types  that  reported  outcomes  of  this  type,  we 
used  a broad  inclusion  criterion  for  study  design  that  encompassed  non-controlled  case 
series  with  20  or  more  subjects.  Even  with  this  broader  basis  for  review,  only  small 
numbers  of  telecardiology  studies  that  reported  outcomes  could  be  identified. 

The  areas  of  benefit  identified  in  the  reports  and,  also,  the  limited  numbers  of  studies 
located  were  consistent  with  findings  from  a recent  systematic  review  on  the 
socio-economic  impact  of  telehealth  52.  Most  of  the  studies  concluded  that 
telecardiology  provided  benefits,  but  such  conclusions  need  to  be  considered  in  the 
context  of  study  quality  and  reliability.  Over  half  of  the  small  number  of  studies  we 
identified  did  no  more  than  establish  the  feasibility  of  telecardiology  in  particular 
settings.  Only  nine  studies  were  of  high  or  good  quality  and  quality  of  all  but  one  of 
the  economic  analyses  was  rated  as  low  or  very  low.  Ten  other  studies  included  some 
economic  component  but  presented  too  little  information  to  be  classified  as  economic 
analyses. 

The  strongest  evidence  of  benefit  was  provided  by  the  studies  on  home  care 
applications  of  telecardiology,  particularly  on  the  care  of  persons  with  heart  failure.  A 
number  of  the  studies  in  this  area  could  be  regarded  with  high  confidence  by  decision 
makers.  Two  of  the  studies  in  emergency  care  were  also  of  high  quality  and  would 
have  provided  appropriate  guidance. 

The  majority  of  the  remaining  studies,  which  included  most  of  those  on  pediatric  and 
adult  hospital  applications,  were  of  low  quality.  Twelve  of  them  were  judged  to  have 
provided  findings  that  were  of  unacceptable  uncertainty  for  decision  makers.  Such 
studies  could  be  regarded  as  providing  no  more  than  preliminary  indications  of  efficacy 
or  other  outcomes  and  would  require  prompt  follow  up  with  more  detailed 
investigations. 

Our  approach  to  appraisal  of  study  quality  relies  on  summing  values  from  two  scales, 
one  related  to  study  performance  and  the  other  to  study  design.  Increasing  values  in 
each  scale  reflect  the  increasing  confidence  in  the  study  results  and  their  relevance  for 
decision  making.  Adding  the  two  types  of  score  recognizes  that  overall  reliability  of  a 
study  for  decision  making  will  depend  on  both  performance  and  design.  The  values  we 
selected  are  based  on  a judgement  regarding  relative  importance  of  study  attributes. 

The  ratio  of  one  third  to  two  thirds  weight  for  design  and  performance  was  taken  to 
reflect  the  weight  that  these  issues  have  in  determining  the  usefulness  of  a telemedicine 
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study  for  decision  making.  This  measure  of  study  reliability  is  based  on  construct 
validity  and  is  not  an  externally  validated  index. 

The  quality  of  economic  studies  was  evaluated  on  the  basis  of  well  - known  criteria 
given  in  an  authoritative  text.  The  overall  level  of  quality  for  the  economic  analyses  in 
the  studies  we  considered  was  low,  and  did  not  compare  well  with  that  seen  in  other 
areas  of  telemedicine  2> 3. 

The  appraisal  of  quality  is  dependent  on  the  information  provided  in  the  reviewed 
papers.  It  is  possible  that  some  of  the  studies  we  considered  were  of  higher  quality  than 
indicated,  and  that  local  decision  makers  might  have  had  the  benefit  of  information  that 
was  not  made  generally  available  through  the  literature.  However,  we  suspect  that  in 
most  cases  the  appraisal  of  the  retrieved  papers  reasonably  reflects  the  level  of 
confidence  that  can  be  placed  in  the  study  findings.  Also,  in  most  cases,  follow-up 
using  studies  with  stronger  methodology  may  not  have  been  undertaken. 

Our  review  suggests  that,  as  in  other  areas  of  telemedicine,  formal  evidence  of  benefits 
from  telecardiology  remains  limited,  other  than  in  some  specific  fields  such  as  home 
care  of  patients  with  heart  failure.  Decision  makers  should  note  the  need  for  follow-up 
of  preliminary  studies  in  order  to  obtain  reliable  outcomes  data  for  telecardiology 
applications. 
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Appendix  A:  Literature  Search  Summary 


Database 

Platform 

Search  Terms 

Cochrane  Library: 

Cochrane 

Collaboration 

Licensed  Resource:  Issue  2, 
2003 

telemedicine  AND  cardiology  OR  heart 
telecardiology 

PubMed:  National 
Library  of  Medicine: 
1966-2003 

http://www.ncbi.nlm.nih.gOv/e 

ntrez/query.fcgi?holding=icau 

ahslib 

Search  #1 

telemedicine  OR  tele-medicine  OR 
telecommunication*  OR  tele-communication* 
OR  telecare  OR  tele-care  OR  telehealth  OR 
tele-health  OR  telenursing  OR  tele-nursing 
OR  telemanagement  OR  tele-management 
OR  telecardiology  OR  tele-cardiology 
remote  consult*  OR  remote  monitor*  OR 
teleconsult*  OR  tele-consult*  OR  remote 
diagnosis  OR  telediagnosis  OR  tele- 
diagnosis 

cardiology  OR  cardiol*  OR  heart  OR  heart 
disease*  OR  electrocardiograph*  OR 
electrocardiography  , ambulatory  OR  chest 
pain/diagnosis 

1 OR  2 AND  3 
Search  #2 

telemedicine  OR  tele-medicine  OR 
telecommunication*  OR  tele-communication* 
OR  telecare  OR  tie-care  OR  telehealth  OR 
tele-health  OR  telenursing  OR  tele-nursing 
OR  telemanagement  OR  tele-management 
OR  telecardiology  OR  tele-cardiology 
cardiology  OR  cardiol*  OR  heart  OR  heart 
disease*  OR  electrocardiograph*  OR 
electrocardiography  , ambulatory  OR  chest 
pain/diagnosis 

cost-benefit  analysis  OR  “cost  analysis”  OR 
cost  OR  “economic  outcome” 

1 AND  2 AND  3 

Science  Citation  Index 

Licensed  Resource: 

Web  Interface:  2003 
http://www.library.ualberta.ca/ 

telecardiology  OR  telemedicine 
echocardiography  OR  cardiology  OR  heart 
disease*  OR  electrocardiogr* 
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Database 

Platform 

Search  Terms 

ECRI’s  International 
Health  Technology 
Assessment  Database 
1990-2003 

http://www.ecri.org/ 

telecardiology 

telemedicine  AND  cardiology  OR  heart 
diseases 

EMBASE:  Elsevier 

Licensed  Resource:  OVID 
Technologies  Search 
Interface 

Excerpta  Medica:  1988  - 
2003 

Search  #1 

cardiology  [SH]  OR  electrocardiography  [SH] 
OR  heart  diseases/diagnosis[SH]  OR  thorax 
pain/diagnosis  [SH]  OR  heart  OR  card* 
“remote  consult*”  OR  “remote  monitoring”  OR 
“teleconsult*” 

telecommunication[SH]  OR  “telehealth”  OR 
“telecardiology”  OR  “telecare”  OR 
“telemedicine”  OR  “telecardiology” 

1 AND  2 AND  3 OR  4 
Search  #2 

cardiology  [SH]  OR  electrocardiography  [SH] 
OR  heart  diseases/diagnosis[SH]  OR  thorax 
pain/diagnosis  [SH]  OR  heart  OR  card* 
“remote  consult*”  OR  “remote  monitoring”  OR 
“teleconsult*”  OR 

telecommunication[SH]  OR  “telehealth”  OR 
“telecardiology”  OR  “telecare”  OR 
“telemedicine”  OR  “telecardiology” 
cost  benefit  analysis  OR  “cost  analysis”  OR 
cost  OR  “economic  analysis” 

1 AND  2 AND  3 

CCOHTA 

http://www.ccohta.ca/publicati 
ons/pubs  e.asp 

telecardiology 

telemedicine  AND  cardiology 

NHS  Centre  for 
Reviews  and 
Dissemination  CRD 
Databases:  HTA, 
EED,  DARE 

http://nhscrd.york.ac.uk 

telecardiology 

telemedicine  AND  cardiology  OR  heart 
disease* 

CMA  Infobase 

http://mdm.ca/cpgsnew/cpgs/i 

ndex.asp 

telemedicine  AND  cardiology 

National  Guideline 
Clearinghouse 

www.guideline.gov 

telemedicine  AND  cardiology 

telecardiology 

remote  consultation 
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Database 

Platform 

Search  Terms 

Telemedicine 

Databases: 

• Meetings 

• Bibliographic 

• Programs 

http://www2.telemedtoday.co 
m / 

telecardiology 

cardiology 

World  Wide  Web 
Search  Engines: 

• Google 

• AlltheWeb 

www.google.com 

www.alltheweb.com 

telecardiology 
remote  cardiology 

remote  consult  AND  cardiology  OR”  heart 
disease” 

Notes: 

Truncation:  The  * symbol  is  a truncation  character  that  retrieves  possible  suffix  variations  of  the  root 
word  e.g.  surg*  retrieves  surgery,  surgical,  surgeon,  etc.  In  databases  accessed  via  the  OVID  platform 
the  truncation  character  is  $; 

Limits:  Searches  were  limited  to  human;  publication  dates:  1992-2003. 
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Appendix  B:  Details  of  selected  telecardiology  studies 
Abbreviations 

AMI:  Acute  myocardial  infarction 
CCU:  Cardiac  care  unit 
ED:  Emergency  department 
€ : Euros 

HKD:  Hong  Kong  dollars 

HMO:  Health  maintenance  organization 

ISDN:  Integrated  Services  Digital  Network 

Itl:  Italian  lira 

LOS:  Length  of  stay 

NICU:  Neonatal  intensive  care  unit 

NKr:  Norwegian  crowns 

NSD:  No  significant  difference 

QOL:  Quality  of  life 

RCT:  Randomized  controlled  trial 

SPECT:  Single  - photon  emission  computerized  tomography 
SS:  Statistically  significant 

Quality  scores 

In  the  following  tables,  quality  scores  are  given  for  each  study.  The  numerical  values 
for  total  quality  and  performance  scores  are  included  together  with  letters  showing  the 
categories  from  Table  3,  which  give  an  indication  of  the  confidence  that  might  be  placed 
in  the  study  results.  An  economic  quality  score  (maximum  10)  is  also  included  for  those 
studies  that  included  economic  analysis. 
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